(11) Japanese Examined Publication: Hei 6-1473 9 
(24) Date of Publication: 23/2/94 

(21) Application No: Sho 60-180106 

(22) Date of Application: 15/8/85 
(73) Applicant: NEC Corporation 

(54) Title: A movement compensation inter-frame prediction 
coding and decoding method for image signals and its 
devices 

(57) Claims: 

1. A movement compensation inter-frame prediction coding 
and decoding method for image signals comprising: 

at a transmission side, 

providing space interpolation of sampled input image 
signals so that the number of samples may be increased; 
detecting blocks of a previous frame of said input image 
signals subjected to space interpolation, having the 
highest similarity to blocks of a present frame of said 
input image s ignal s ; 

finding minority movement vectors showing drifts between 
said blocks of said present frame and said detected blocks 
of said previous frame; 

finding prediction error signals and local decoded signals 
from said input image signals and prediction signals; 
providing space interpolation of said local decoded 
signals ; 

providing variable delay of said local decoded signals 
subjected to space interpolation in accordance with said 
minority movement vectors to form said prediction signals; 
and 

providing compression coding of said prediction error 

signals and said minority movement vectors before 

transmitted, 

at a reception side, 

providing extension decoding of said prediction error 
signals and said minority movement vectors, subjected to 
compression coding; 

regenerating regenerative image signals from said 
prediction error signals subjected to extension decoding 
and reception-side prediction signals; 

providing space interpolation of said regenerated image 
signals; and 

providing variable delay of said regenerated image signals 
subjected to space interpolation in accordance with said 
minority movement vectors subjected to extension decoding 
to form said reception-side prediction signals. 

2 . A movement compensation inter-frame prediction coding 
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device for image signals comprising: 

means for providing space interpolation of sampled input 
signals so that the number of samples may be increased; 
means for detecting blocks of a previous frame of said 
input image signals subjected to space interpolation, 
having the highest similarity to blocks of a present frame 
of said input image signals, and finding minority movement 
vectors showing drifts between said blocks of said present 
frame and said detected blocks of said previous frame; 
means for finding prediction error signals and local 
decoded signals from said input image signals and 
prediction signals ; 

means for providing space interpolation of said local 
decoded signals; 

means for providing variable delay of said local decoded 
signals subjected to space interpolation in accordance with 
said minority movement vectors to form said prediction 
signals; and 

means for providing compression coding of said prediction 
error signals and said minority movement vectors. 
3. A movement compensation inter-frame prediction decoding 
device for image signals comprising: 

means for detecting minority movement vectors in blocks for 
image signals, inputting signals consisting of prediction 
error signals, obtained by movement compensation inter- 
frame prediction coding in accordance with said minority 
movement vectors, and said minority movement vectors, both 
of which are subjected to compression coding, and providing 
extension decoding of said prediction error signals and 
said minority movement vectors, subjected to compression 
coding; 

means for regenerating regenerative image signals from said 
prediction error signals subjected to extension decoding 
and reception-side prediction signals ; 

means for providing space interpolation of said regenerated 
image signals; 

means for providing variable delay of said regenerated 
image signals subjected to space interpolation in 
accordance with said minority movement vectors subjected to 
extension decoding; and 

means for providing space trimming of said regenerated 
image signals subjected to variable delay to form said 
reception-side prediction signals. 

BACKGROUND OF THE INVENTION 
[FIELD OF THE INVENTION] 

The present invention relates to a movement 
compensation inter-frame prediction coding and decoding 




method for image signals and its devices (referred to as "a 
prediction coding method" and w a prediction decoding 
method", and "a prediction coding device" and "a prediction 
decoding device", respectively), in particular, to a block 
matching type prediction coding and decoding method for 
efficiently coding and decoding image signals and its 
devices . 

[PRIOR ART] 

One of procedures in a prediction coding and decoding 
method for image signals is movement compensation inter- 
frame prediction coding and decoding. The method involve 
the use of signals of a previous frame drifted by movement 
vectors, instead of the direct use of signals of the 
previous frame, as prediction signals. 

Fig. 6 shows the movement of image signals in the 
movement compensation inter- frame prediction coding and 
decoding method. For example, as shown in Fig. 6, a value 
for a prediction signal to a signal A on coordinates (Xo, 
Y 0 ) at a time t=to is determined by a signal C on 
coordinates (Xo-V x , Yo-V Y ) in a front frame at a time t=t 0 - 
T, if a movement vector is 6=(V X , V Y ) . The movement vector 6 
is the amount of displacement in one frame for an image 
near the signal A and its size and direction are generally 
different depending on the position of the signal A. In the 
method, if only the movement vector can be found precisely, 
the value for the signal C approximates the value for the 
signal A and so a prediction error signal gets to a small 
value, close to zero, producing higher coding efficiency. A 
block matching method or the like is proposed for how to 
find the movement vector. The block matching method is 
explained as follows: 

An image is first divided into a number of blocks. 
Then, a number of drifted blocks is picked out of the 
previous frame and one block of the highest similarity is 
detected from them. Drifts between the blocks of the 
present frame and the blocks of the previous frame at this 
time are movement vectors . One example of the movement 
compensation inter-frame prediction coding using block 
matching is detailed in a paper "A movement compensation 
prediction system for inter-frame prediction coding" by 
Ninomiya., published in "1981 electronic communications 
institution magazine B" Vol.J64-B, Nol, P24-P31. 
[Problems of Prior Art] 

In the above -described conventional movement 
compensation inter- frame prediction coding and decoding for 
image signals of lower space resolution, there is the 
disadvantage of producing more information content per 
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picture element, than in the movement compensation inter- 
frame prediction coding and decoding for image signals of 
higher space resolution. The reason is as follows: 

In case of the movement compensation inter- frame 
prediction coding and decoding when a true movement vector 
is located between picture elements, the quantitized 
movement vector is detected at the position of one of two 
picture elements during detecting the movement vector, 
because the true movement vector is not found. Therefore, 
the lower space resolution the image signals, the larger 
space between the picture elements, resulting in the 
movement vector to be detected more roughly, a larger value 
for the prediction error signal and more information 
content per picture element. 
[Objects of the Present Invention] 

An object of the invention is to provide a block 
matching type movement compensation inter- frame prediction 
coding and decoding method for image signals of lower pace 
resolution, wherein less information content per picture 
element is produced with less deterioration of imaging 
quality, than in the conventional block matching type 
movement compensation inter- frame prediction coding and 
decoding method, and to provide its devices. 

[Configuration of the Invention] 

1. A prediction coding and decoding method according this 
invention comprises : 
at a transmission side, 

providing space interpolation of sampled input image 
signals so that the number of samples may be increased; 
detecting blocks of a previous frame of said input image 
signals subjected to space interpolation, having the 
highest similarity to blocks of a present frame of said 
input image signals; 

finding minority movement vectors showing drifts between 
said blocks of said present frame and said detected blocks 
of said previous frame; 

finding prediction error signals and local decoded signals 
from said input image signals and prediction signals; 
providing space interpolation of said local decoded 
signals ; 

providing variable delay of said local decoded signals 
subjected to space interpolation in accordance with said 
minority movement vectors to form said prediction signals ; 
and 

providing compression coding of said prediction error 
signals and said minority movement vectors before 
transmitted, 
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at a reception side, 

providing extension decoding of said prediction error 
signals and said minority movement vectors, subjected to 
compression coding ; 

regenerating regenerative image signals from said 
prediction error signals subjected to extension decoding 
and reception-side prediction signals; 

providing space interpolation of said regenerated image 
signals; and 

providing variable delay of said regenerated image signals 
subjected to space interpolation in accordance with said 
minority movement vectors subjected to extension decoding 
to form said reception-side prediction signals. 

2 . A prediction coding device according to this invention 
comprises : 

means for providing space interpolation of sampled input 
signals so that the number of samples may be increased; 
means for detecting blocks of a previous frame of said 
input image signals subjected to space interpolation, 
having the highest similarity to blocks of a present frame 
of said input image signals, and finding minority movement 
vectors showing drifts between said blocks of said present 
frame and said detected blocks of said previous frame ; 
means for finding prediction error signals and local 
decoded signals from said input image signals and 
prediction signals ; 

means for providing space interpolation of said local 
decoded signals; 

means for providing variable delay of said local decoded 
signals subjected to space interpolation in accordance with 
said minority movement vectors to form said prediction 
signals; and 

means for providing compression coding of said prediction 
error signals and said minority movement vectors. 

3 . A prediction decoding device according to this invention 
comprises : 

means for detecting minority movement vectors in blocks for 
image signals, inputting signals consisting of prediction 
error signals, obtained by movement compensation inter- 
frame prediction coding in accordance with said minority 
movement vectors, and said minority movement vectors, both 
of which are subjected to compression coding, and providing 
extension decoding of said prediction error signals and 
said minority movement vectors, subjected to compression 
coding ,- 

means for regenerating regenerative image signals from said 
prediction error signals subjected to extension decoding 
and reception-side prediction signals; 
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means for providing space interpolation of said regenerated 
image signals; 

means for providing variable delay of said regenerated 
image signals subjected to space interpolation in 
accordance with said minority movement vectors subjected to 
extension decoding; and 

means for providing space trimming of said regenerated 
image signals subjected to variable delay to form said 
reception-side prediction signals. 
[Principle of the Invention] 

Conventional movement compensation inter- frame 
prediction coding and decoding applied to image signals of 
lower space resolution makes values for prediction error 
signals, whose movement vectors are detected roughly, 
larger to produce more information content per picture 
element. In this invention, conventional block matching 
type movement compensation inter-frame prediction coding 
and decoding is changed in two following points: 

(i) During detecting the movement vectors, the image 
signals of lower space resolution are subjected to space 
interpolation so that their fine movement can be detected 
which could not be detected before space interpolation. 

(ii) After subjected to space interpolation, local 
decoding signals are subjected to minority picture element 
delay in accordance with minority movement vectors and then 
to space trimming again, whereby they are restored to their 
old resolution, not subjected under space interpolation, to 
form prediction signals. 

At a position of a previous frame shown by the movement 
vectors detected in the above-described (i) , no sampling 
point exists before space interpolation, and so the 
movement vectors are called minority movement vectors in 
this invention. 

Since the prediction signals compensated for the fine 
movement can be formed in the procedures shown in the 
above-described (ii), accurate prediction is ensured, 
compared to that in the conventional block matching type 
movement compensation inter- frame prediction coding and 
decoding method for the image signals of lower space 
resolution . 
[ EMBODIMENTS ] 

The present invention is described with reference to 
the drawings . 

Each of Fig.l through Fig. 4 is a block diagram 
showing a prediction coding device according to each of 
first through fourth embodiments of the invention, Fig. 5 is 
a block diagram showing a prediction decoding device 
according to one embodiment of the invention and Fig. 6 is 
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an explanatory drawing showing the movement of image 
signals between movement compensation frames in a 
prediction coding and decoding method. 

In Fig.l, a first embodiment for the prediction 
coding device according to the invention is first 
described. Image signals applied to an input terminal 100 
is supplied to a subtracting circuit 13, a block matching 
type minority movement vector detecting circuit 10 and a 
frame memory 11 capable of storing one frame. The image 
signals supplied to the frame memory 11 is sent to a space 
interpolating circuit 12, where they are subjected to space 
interpolation, and used in detecting minority movement 
vectors after about one frame time delay. In the block 
matching type minority movement vector detecting circuit 
10, the image signals supplied from the input terminal 100 
and image signals of a previous frame supplied from the 
space interpolating circuit 12 after space interpolation 
are used in detecting the movement of images. The minority 
movement vectors detected by the block matching type 
minority movement vector detecting circuit 10 are supplied 
to a variable delay circuit 19 and a compression coding 
circuit 21. In the subtracting circuit 13, a difference 
between the image signals supplied from the input terminal 
10 0 and prediction signals supplied from a space trimming 
circuit 20 after space trimming is found. The difference, 
namely, prediction error signals, is supplied to a 
quantizing circuit 14 for quantization. The quantization 
includes linear quantization and non-linear quantization, 
one of which is selected. In the linear quantization, the 
low-order bits of the prediction error signals are trimmed 
and the number of the bits are thus reduced, providing less 
information content to be transmitted. In the non-linear 
quantization, the number of bits of the prediction error 
signals is reduced with quantizing operation in accordance 
with the characteristics of the non-linear quantization. 
The quantized prediction error signals are supplied to an 
inversely quantizing circuit 15 and the compression coding 
circuit 21. The prediction error signals supplied to the 
inversely quantizing circuit 15 are inversely quantized 
herein and then supplied to an adding circuit 16. The 
inverse quantization includes linear inverse quantization 
and non-linear inverse quantization, one of which is 
selected. In the linear inverse quantization, zeroes in 
number equivalent to the number of bits trimmed in the 
quantizing circuit 14 are added to the low-order positions 
of the prediction error signals to be restored to the 
number of their old bits, not subjected under quantization. 
In the non-linear inverse quantization, similar operation 
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of restoring the prediction error signals to the number of 
their old bits, not subjected under quantization, is 
carried out in accordance with the characteristics of the 
non-linear inverse quantization. In the adding circuit 16, 
the sum of the prediction error signals supplied from the 
inversely quantizing circuit 15 after inverse quantization 
and prediction signals supplied from the space trimming 
circuit 2 0 is found. The sum, namely, local decoding 
signals, is supplied to a frame memory 17, from which it is 
then output to a space interpolating circuit 18. In the 
space interpolating circuit 18, the local decoding signals 
are subjected to space interpolation and then supplied to 
the variable delay circuit 19. In the variable delay 
circuit 19, the prediction signals compensated for movement 
by using minority movement vectors supplied from the block 
matching type minority movement vector detecting circuit 10 
are generated and then supplied to the space trimming 
circuit 20. In the space trimming circuit 20, the 
prediction signals are subjected to space trimming and then 
supplied to the subtracting circuit 13 and the adding 
circuit 16. In the compression coding circuit 21, the 
prediction error signals supplied from the quantizing 
circuit 14 after quantization and the minority movement 
vectors supplied from the block matching type minority 
movement vector detecting circuit 10 are subjected to 
compression coding and then output to a transmission 
passage 1000 . 

A second embodiment shown in Fig. 2 is described, 
wherein the prediction coding device excludes the 
quantizing circuit 14 and the inversely quantizing circuit 
15, shown in Fig.l. In the second embodiment, a difference 
between the image signals supplied from the input terminal 
100 and the prediction signals supplied from the space 
trimming circuit 2 0 after space trimming, namely the 
prediction error signals, is applied to the compression 
coding circuit 21 and the adding circuit 16 as it is. In 
this case, high quality coded images with no quantization 
error are obtained. 

A third embodiment shown in Fig. 3 is described, 
wherein the prediction coding device has a function equal 
to that of the prediction coding device which excludes the 
quantizing circuit 14 and the inversely quantizing circuit 
15, shown in Fig.l, and a structure different from that in 
the second embodiment. In the third embodiment, image 
signals supplied from an input terminal 3 00 are applied to 
a subtracting circuit 33 and also applied to a frame memory 
34. The image signals applied to the frame memory 34 are 
passed through a space interpolating circuit 35, a variable 
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delay circuit 36 and a space trimming circuit 37, subjected 
to movement vector delay and then applied to the 
subtracting circuit 33. In the subtracting circuit 33, a 
difference between the image signals subjected to the 
movement vector delay and image signals subjected to 
completely no delay is operated, and the difference signals 
are given to a compression coding circuit 38. 

In the first embodiment shown in Fig.l, orthogonal 
transformation such as Discrete Cosine Transform (DCT) , 
instead of quantization, can be performed, which is 
properly selected for purposes. 

In a fourth embodiment, another prediction coding 
device may be considered, which uses input image signals 
and local decoding signals subjected to space interpolation 
during detecting movement vectors . In the fourth embodiment 
shown in Fig. 4, a block matching type minority movement 
vector detecting circuit 40 detects movement vectors by 
comparing the image signals supplied from an input terminal 
400 with local decoding signals obtained from a space 
interpolating circuit 46 after space interpolation, and 
applies them to a variable delay circuit 47. In this case, 
only one frame memory is required, resulting in a simple 
structure . 

One embodiment of the prediction decoding device 
according to the invention is described with reference to 
Fig. 5. Signals supplied from a transmission passage 5000 
after compression coding are supplied to an extension 
decoding circuit 50. In the extension decoding circuit 50, 
prediction error signals subjected to compression decoding 
and minority movement vectors are subjected to extension 
decoding and then supplied to an inversely quantizing 
circuit 51 and a variable delay circuit 55, respectively. 
In the inversely quantizing circuit 51, the prediction 
error signals quantized are inversely quantized and then 
supplied to an adding circuit 52. In the adding circuit 52, 
image signals are subjected to prediction decoding from the 
prediction error signals supplied f rom the inversely 
quantizing circuit 51 after inverse quantization and the 
prediction signals supplied from a space trimming circuit 
56. The image signals subjected to prediction decoding are 
supplied to an output terminal 500 and a frame memory 53. 
The image signals supplied to the frame memory 53 is sent 
to a space interpolating circuit 54 where they are 
subjected to space interpolation, and then supplied to a 
variable delay circuit 55 to generate prediction signals. 
In the variable delay circuit 55, the prediction signals 
are generated in accordance with minority movement vectors 
supplied from the extension decoding circuit 50, and then 



9 



supplied to a space trimming circuit 56. In the space 
trimming circuit 56, the prediction signals are subjected 
to space trimming and then supplied to an adding circuit 
52 . 

[Effects of the Invention] 

According to the invention as above-described, 

(i) during the detection of the movement vectors, the image 
signals of lower space resolutions are subjected to space 
interpolation so that their fine movement, which could not 
be detected before space interpolation, can be detected. 

(ii) After subjected to space interpolation, local decoding 
signals are subjected to minority picture element delay in 
accordance with minority movement vectors and then to space 
trimming again, whereby they are restored to their old 
resolution, not subjected under space interpolation, to 
form prediction signals. 

This causes fine detection and accurate prediction of 
the movement vectors, compared to those in the conventional 
block matching type movement compensation inter- frame 
prediction coding and decoding method for the image signals 
of lower space resolution, advantageously producing smaller 
values for the prediction error signals and less 
information content per picture element. 



BRIEF DESCRIPTION OF THE DRAWINGS 

Each of Fig.l through Fig. 4 is a block diagram 
showing a prediction coding device according to each of 
first through fourth embodiments of the invention, Fig. 5 is 
a block diagram showing a prediction decoding device 
according to one embodiment of the invention and Fig. 6 is 
an explanatory drawing showing the movement of image 
signals between movement compensation frames in a 
prediction coding and decoding method. 



In the drawings , 

10, 30, 40: block matching type minority movement vector 
circuit , 

11, 17, 31, 34, 45, 53: frame memory, 

12, 18, 32, 35, 46, 54: space interpolating circuit, 

13, 33, 41: subtracting circuit, 

14, 42: quantizing circuit, 

15, 43, 51: inversely quantizing circuit, 

16, 44, 52: adding circuit, 

19, 36, 47, 55: variable delay circuit, 

20, 37, 48, 56: space trimming circuit, 

21, 38, 49: compression coding circuit, 
50: extension decoding circuit, 

100, 300, 400: input terminal, 
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500 : output terminal , 

1000, 3000, 4000, 5000: transmission passage 
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(54) METHOD AND APPARATUS FOR FORECAST CODING AND DECODING OF DYNAMIC 
COMPENSATION INTER-FRAME OF PICTURE SIGNAL 

(57) Abstract : 

PURPOSE: To reduce information per picture element while suppressing 
deterioration of picture quality by applying spatial interpolation to a local 
decoding signal, applying variable delay to the local decoding signal subjected 
to spatial interpolation according to a minority dynamic vector to form a 
forecast signal. 

CONSTITUTION: In detecting a dynamic vector, minute movement not detected before 
spatial interpolation is detected by applying spatial interpolation to a picture 
signal with deteriorated spatial resolution. After a local decoding signal is 
subjected to spatial interpolation, a few picture elements are retarded 
according to the minority dynamic vector. Then spatial interleaving is applied 
to restore the resolution to the resolution before spatial interpolation and the 
result is used as a forecast signal. Thus, in comparison with the application of 
the conventional block matching dynamic compensation inter-frame forecast coding 
and decoding method, the dynamic vector is detected in detail and more suitable 
forecast is applied, then the value of the forecast error signal is decreased 
and the information quantity per picture element is reduced. 
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